Image analysis system

ABSTRACT

Systems and methods are disclosed for determining a pitch of a roof of a structure by analyzing one or more images showing the roof, at least one of the one or more image showing the roof obtained with a camera of a user device and an image not obtained by the user device. The system uses the one or more images including an image obtained by the user device to generate a report for determination of an amount of materials needed for a construction project, the report including at least one image showing the structure and an estimated area of the construction project.

CROSS-REFERENCE TO RELATED APPLICATIONS/INCORPORATION BY REFERENCE

This application is a continuation of and claims priority to U.S. patentapplication Ser. No. 17/095,474, filed Nov. 11, 2020, which is acontinuation of and claims priority to U.S. patent application Ser. No.15/967,140, filed Apr. 30, 2018, now U.S. Pat. No. 10,839,469, which isa continuation of U.S. patent application Ser. No. 13/844,552 filed Mar.15, 2013, now U.S. Pat. No. 9,959,581, entitled “Property Management ona Smartphone,” the entire contents of which are hereby incorporatedherein by reference.

BACKGROUND Technical Field

The present disclosure relates to systems and methods used to track andmanage multiple properties and the various attributes andcharacteristics of each property and buildings on the property on asmartphone or mobile device.

Description of the Related Art

Property management systems that track conditions, features, and otherattributes of one or more properties have typically used paper-basedsystems that have involved manual updates when property data is changedor new properties to manage are added. In some instances, features andattributes of different properties have been stored as individualrecords in a database, for example a government database containingproperty records for parcel numbers, address, year built, square footageestimate, and the like.

Pitch determination systems that are used, for example, to determine apitch of a roof have traditionally involved a person visiting theproperty and measuring the roof using a tape measure and level.Recently, systems have been introduced by EagleView Technologies, Inc.that allow multiple aerial images to be used to render athree-dimensional model of the roof and to produce a roof report fromwhich the pitch of a roof may be determined.

BRIEF SUMMARY

In one embodiment, a property management system operates on a smartphonedevice and allows a user to identify one or more properties to bemanaged, to order a roof report for the one or more properties and tohave the result of that roof report returned to and stored on thesmartphone device. The property management system also allows thesmartphone user to edit or add data associated with the property,including the roof report for the property, by adding photos, editingphotos, annotating photos, and updating and adding text information tothe property data stored on the smartphone.

Systems and methods for determining pitch are also disclosed that allowa smartphone to be used to determine the pitch of a facet of an object.In one embodiment, the smartphone uses an image representing a facet ofan object for which a pitch is to be determined and receives anindication from a user of the start and end point of a line on thefacet. The system uses metadata information contained in the image andthe indication of the facet to determine the pitch of the facet. Inanother embodiment, the system allows a user to take a picture of thefacet to be measured with a smartphone camera. The system uses featuresof the phone, such as the accelerometer, to determine the orientation ofthe camera when the picture was taken. This information, along with theuser's identification of the facet to be measured, is used to determinethe pitch of the facet. In other embodiments, visual recognition is usedto identify a facet within an image and to calculate the pitch of thefacet.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 describes an overview of an architecture to implement a propertymanagement system on a smartphone, as well as a property managementsystem that runs on a smartphone and is coordinated with the database onthe server.

FIGS. 2A-2AD are example screenshots of one embodiment for acquiring andtracking data for one or more buildings on one or more properties.

FIGS. 3A-3X are example screenshots of one embodiment for acquiring andtracking data for one or more buildings on one or more properties.

FIGS. 4A-4E are example screenshots from one or more embodiments foracquiring and updating three-dimensional models for one or morebuildings on one or more properties.

FIGS. 5A-5L are example screenshots from one embodiment for capturing,modifying, and annotating image data for one or more buildings on one ormore properties.

FIG. 6 is an example screenshot of a three-dimensional model used tocapture, modify, and annotate building characteristics on a tabletdevice.

FIG. 7 is a diagram showing a part of a process for positioning thecamera to determine the slope of an object at a distance using asmartphone.

FIG. 8 is a diagram showing a part of a process for orienting the camerato determine the slope of an object at a distance using a smartphone.

FIG. 9A is a diagram showing a part of a process for orienting thecamera in a near field to determine the slope of an object at a distanceusing a smartphone.

FIG. 9B is a picture showing a part of a process for orienting thecamera in a near field to determine the slope of an object at a distanceusing a smartphone.

FIG. 10A is a diagram showing a part of a process for orienting thecamera in a far field to determine the slope of an object at a distanceusing a smartphone.

FIG. 10B is a picture showing a part of a process for orienting thecamera in a far field to determine the slope of an object at a distanceusing a smartphone.

FIG. 11 is a diagram showing a part of a process involving an operationof a scissor marker which can be overlaid on image to determine theslope of an object at a distance using a smartphone.

FIG. 12 is a diagram showing examples of manipulating a marker overlaidon image to determine the slope of an object at a distance using asmartphone.

FIG. 13 is a diagram showing examples of selecting a marker overlaid onimage to determine the slope of an object at a distance using asmartphone.

DETAILED DESCRIPTION

FIG. 1 shows one embodiment of a block diagram of a computer hardwaresystem to obtain and described herein provide enhanced computer- andnetwork-based methods, techniques, and systems for building structureestimation employing perspective imagery from independent sources.

FIG. 1 is therefore one example block diagram of a computing system 100for practicing embodiments of the statistical point pattern matchingmethod described herein, and for practicing embodiments of a buildingstructure estimation system based on the point pattern matching,according to one embodiment.

One or more general purpose or special purpose computing systems may beused to implement the computer- and network-based methods, techniques,and systems for point pattern matching computation described herein andfor practicing embodiments of a building structure estimation systembased on the point pattern matching. More specifically, the computingsystem 100 may comprise one or more distinct computing systems presentat distributed locations. In addition, each block shown may representone or more such blocks as appropriate to a specific embodiment or maybe combined with other blocks. Moreover, in one example embodiment, thevarious components of a Building structure estimation system 114 mayphysically reside on one or more machines, which use standardinter-process communication mechanisms (e.g., TCP/IP) to communicatewith each other. Further, the Building structure estimation system 114may be implemented in software, hardware, firmware, or in somecombination to achieve the capabilities described herein.

Examples of computing systems and methods to obtain a roof report areshown and described in detail in U.S. Pat. Nos. 8,078,436 and 8,170,840and these can be used as one component of the present embodiment, aswell as other roof report generation systems. For completeness, onepotential system for creating such a report will be described herein asfollows.

In the embodiment shown, the computing system 100 comprises a computermemory (“memory”) 102, a display 104, one or more Central ProcessingUnits (“CPU”) 106, Input/Output devices 108 (e.g., keyboard, mouse,joystick, track pad, CRT or LCD display, and the like), othercomputer-readable media 110, and network connections 112. A buildingstructure estimation system 114 is shown residing in the memory 102. Inother embodiments, some portion of the contents or some or all of thecomponents of the building structure estimation system 114 may be storedon and/or transmitted over the other computer-readable media 110. Thecomponents of the building structure estimation system 114 preferablyexecute on one or more CPUs 106 and generate roof estimate reports, asdescribed herein. Other code or programs 116 (e.g., a Web server, adatabase management system, and the like) and potentially other datarepositories, such as data repository 118, also reside in the memory102, and preferably execute on one or more CPUs 106. Not all of thecomponents in FIG. 1 are required for each implementation. For example,some embodiments embedded in other software do not provide means foruser input, for display, for a customer computing system, or othercomponents. Currently, some inputs to the building structure estimationsystem 114 are automatically generated, but other inputs may be enteredmanually to supplement data acquired through automated means. Furtherautomation of the building structure estimation system, includingautomation of roof materials overage estimation is a goal addressed bythe method described herein, along with other methods.

In a typical embodiment, the building structure estimation system 114includes an image acquisition engine 120; a roof modeling engine 122; apoint pattern matching computation engine 124, and a roof materialsoverage computation engine 125 within, or as part of, the roof modelingengine 122; a report generation engine 126, an interface engine 128, anda data repository 130. Other and/or different modules may beimplemented. In addition, the building structure estimation system 114interacts via a network 132 with an image source computing system 134,an operator computing system 136, and/or a customer computing system138. Communication system 132 may utilize one or more protocols tocommunicate via one or more physical networks, including local areanetworks, wireless networks, dedicated lines, intranets, the Internet,and the like.

The image acquisition engine 120 performs at least some of the functionsdescribed herein, with respect to the processes described herein. Inparticular, the image acquisition engine 120 interacts with the imagesource computing system 134 to obtain one or more images of a building,and stores those images in the building structure estimation system datarepository 130 for processing by other components of the buildingstructure estimation system 114.

The roof modeling engine 122 performs at least some of the functionsdescribed with reference to FIGS. 2-13 below. In particular, the roofmodeling engine 122 generates a model based on one or more images of abuilding that are obtained from the building structure estimation systemdata repository 130 or directly from the image source computing system134. As noted, model generation may be performed semi-automatically,based on at least some inputs received from the operator computingsystem 136.

In addition, at least some aspects of the model generation may beperformed automatically. In particular, to generate a 3D model, the roofmodeling engine 122 may use output from the point pattern matchingcomputation engine 124 which employs variational analysis to compute apoint-to-point probability spread function. The point-to-pointprobability spread function can be used to estimate which individualpoints on one image of the building most likely match correspondingpoints on another image of the building (i.e., the point patternmatching computation engine endeavors to “optimize” point matchingassociations). This estimation may be based on adaptive predominancevoting probabilities generated from shape pattern matches. The shapepattern matches can be created by comparing combinations of points on anorthogonal view of the building with specific other points on an obliqueview of the building, and as further described herein.

Property Management

FIGS. 2A-2AD describe systems and methods for using a smartphone tomanage multiple properties, and to access the attributes andcharacteristics of buildings on the properties. The term “smartphone” asused herein is intended in its broadest sense to include any Internetcapable small mobile device and as such includes within its meaning atablet, mini-computer or other mobile device that has a wirelessconnection to the Internet and an internal microprocessor.

In one or more embodiments, property management systems, includingsoftware modules may be used to track physical features of property,such as location of the property, valuation of the property, number ofbuildings on the property, and information about the buildings on theproperty. This information may include photographs of different areas ofindividual buildings such as roofs, walls, interiors, surrounding areasoutside the building structure such as groundcover, shrubs that may begrowing against the structure, and other building conditions that canvisually documented and assessed. Property management systems may alsobe used to store building information such as two-dimensional orthree-dimensional models of the building including the roof structure.Other information may be kept in a property management system includingownership of the property, taxes paid on the property, reports ofrepairs or insurance claims against structures of the property, and thelike.

The information stored in a property management system on a smartphonemay be implemented by entering all data directly into the smartphone,however the preferred embodiment is for property management informationto be shared between the smartphone at one or more property managementdatabases on a server. In this way, property management informationupdated at the server can be sent to the smartphone device, andinformation gathered by the property management system on the smartphonedevice can be used to update information for the property on the server.One embodiment of sharing would be to synchronize the database on thesmartphone via a web service that also queries the server database.

In one or more implementations, the system on the smartphone is able toretrieve information about properties that was acquired through productsthat were ordered about those properties. For example, roof reports,walls reports, solar reports, and other similar reports may be orderedfor a property from EagleView Technologies, Inc. These reports providedetailed analysis and description of characteristics of the propertythat include for example the number of facets on a roof, the pitch ofeach facet, the square footage of the roof, a three-dimensional model ofthe building, walls information for the building, total living areawithin the structure, and the like.

For example, a user at a property site, such as an insurance adjustor ora contractor, may use the property management system on the contractor'ssmartphone to determine if such a report exists for the property. If so,the user can look through the list of properties on the smartphone,locate the property, and view the property information. Optionally, theuser may query the server to see if updated information on the propertymay be available. If such a report does not exist for a property, thenthe user can order one from the property management system on thesmartphone. In some cases, the results of a report request may bereturned within several minutes. For example, if a contractor isavailable at a customer site and a report request is returned within theperiod of time that the contractor is at the property, the contractorwill be able to provide the customer with an accurate repair orconstruction bid estimate before the contractor leaves the property.This has the advantage of providing the property owner with a quick,accurate bid, and the advantage of not requiring separate trips onbehalf of the contractor to the property.

In some embodiments, in addition to reports other items may be requestedfor download, including data, diagrams, GIS data, and geometric modelsof buildings relevant to the property of interest and immediatesurrounding areas.

In one embodiment, if a three-dimensional model or diagram derived froma model already existed on the server because of a previous request fora model of a property or the property model was pre-computed for aparticular geographic area, a model of the property, including anyregeneration of diagrams or documents related to the model, would beimmediately downloaded to the smart phone. In the case that thethree-dimensional model was not on the smart phone or on the server, themodel, and any diagrams or documents derived from the model, would begenerated on demand from the imagery and associated image metadata forthe property, or from intermediate precursor data for the property suchas point clouds derived from the images and metadata.

FIG. 2A-2AD show examples of an interface of a property managementsystem on a smartphone.

FIG. 2A shows screen 201 used to login to the property management systemrequiring an email name and a password. The system also allows the userto remember the details selected when previously using the system, aswell as allowing the user to sign in automatically.

FIG. 2B shows screen 202 that is displayed when the smartphone isupdating the orders for property reports in its database with orders inthe server database. FIG. 2C shows screen 203 that is displayed as aresult of the update, and for recent properties that have been viewed,lists the address of the property, a claim number associated with theproperty, a thumbnail image of the property, and also a date and timethat reflects the time that the order was completed. In one embodiment,the claim number could be used to list the displayed properties. Inother embodiments, other fields could be chosen to include on thescreen, including but not limited to a report type or a category ID.There are also buttons at the bottom of the screen that can be used tosort the results for the displayed orders. For example, these buttonscan be used to show only completed orders, in-progress orders, or newlyplaced orders. In addition, a settings button is available to changesettings or default values for the property management system.

FIG. 2D shows screen 204 that is displayed when a specific property isselected from the previous screen. Information about the property isshown including a thumbnail image, order number, address, claim number,type of report, price of the report, whether the report was requested asan express report, and pitch of the roof for a building on the property.In addition, a button is displayed at the bottom which allows the userto add photos to the report, such as photos taken with the user'ssmartphone camera, or images stored on the user's smartphone.

In one or more embodiments, photos or video that is taken of property orbuildings on a property can be used as a source of imagery to be used incombination with, or in place of aerial imagery for generatingthree-dimensional models of structures and other objects and features ofthe property.

FIG. 2E shows a screen 205 that shows more details on the informationfor the property, including the batch ID of the report, cat ID, the dateand time that the order was placed and was completed, the type ofstructure of buildings on the property, and whether this was a referralfrom another property evaluation company.

FIG. 2F shows screen 206 that is displayed when the user selects thecompleted orders button at the lower part of the screen. In thisexample, the user does not have any completed orders that are available,therefore nothing is shown in this screen shot. If there were acompleted order, it would be shown here.

FIG. 2G shows screen 207 which is displayed when the “In Progress”button at the bottom of the screen is clicked. A search area isdisplayed at the top of the screen, and below the search area the mostrecent accessed orders in progress are displayed for each property. Athumbnail image if available is displayed on the left hand side next tothe address of the property. The date an order was placed, as well asthe claim number for the property is shown. The arrow to the right ofeach property listing can be selected for more detailed information.

FIG. 2H shows screen 208 which is displayed when more information isrequested by selecting the right arrow on the preview screen. The statusof the order for the property is shown as “In Progress,” and next tothat a button is displayed that allows the smartphone user to add aphoto or other image of the property if available. Below that, theaddress of the property, claim number, date and time the report wasplaced, the type of report, and whether the report was marked as expressis also shown. In addition, the “Measure Pitch” button may be selected,which takes the user to the screen 224. The user is also allowed to addor view photos associated with the property.

FIG. 2I shows screen 209 that allows the user to sort orders by one ormore criteria, such as but not limited to the date the order was placed(either newest first or oldest first), claim number, cat ID, and batchID.

FIG. 2J shows the screen 210 which is displayed when the user places anew order. The user has the option of either adding a current location,or adding a new address.

FIG. 2K shows screen 211 which is displayed when the user selects the“Add Current Location” button from the previous screen. A map ispresented that shows the locations available, and highlights onelocation for a report with a pin below an abbreviated address. An arrownext to the address allows the user to enter or view more information.In addition, the latitude and longitude of the property is displayed atthe lower part of the screen.

FIG. 2L shows screen 212 which is displayed when the rolled up map iconat the bottom of the previous screen is selected. The user is given theoption to view either a street map, a satellite map, or a hybrid of bothmaps. When the user is ready to identify the location, the user selectsthe “Drop Pin” button to either drop or move the pin.

FIG. 2M shows screen 213 which is displayed after the actions on theprevious screen are complete if the listed address is not exact, forexample the listed house number does not exist. If this occurs, FIG. 2Nshowing screen 214 is displayed that presents the nearest correctaddress. FIG. 2O shows screen 215 which is an interface to allow theuser to enter corrections to the address, or to enter in an entirely newaddress.

FIG. 2P shows screen 216 which is displayed when the user selects the“Add New Address” button from screen 210. The user may enter the streetaddress, city, state, and ZIP Code. In addition, the user can designatea country, which is shown here as the United States.

FIG. 2Q shows screen 217 which is displayed after address information isadded from the previous screen. A “New Order” title serves as aplaceholder for the order next to the “Add Photo” button. The enteredaddress is also displayed. The user is able to select the report toorder by toggling through the report selection options by selecting theleft or right arrow keys. In this example, a “Premium” report isselected. The user also selects the delivery speed of the report bytoggling through the delivery options by selecting the left or rightarrow keys. In this example, a “Regular” report is ordered. Similarly,the user can specify the number of structures located at the propertyaddress, whether there had been any changes within the last two years,and the property type, which includes but is not limited to residentialand commercial.

FIG. 2R shows screen 218 which is a continuation of screen 217 that isdisplayed when the user scrolls down screen 217. The user is able toselect the “Add More Details” button or the “Measure Pitch” button whichwould take the user to screen 222. The user places the order byselecting the “Place Order” button.

FIG. 2S shows screen 219 which is displayed when the “Add More Details”button on screen 218 is selected. Here, the user is able to enter aclaim number, a purchase order number, or additional comments infree-text form to be associated with the order. In some embodiments,additional information may entered into this screen including, but notlimited to claim information, building ID, promotion code, or other.

FIG. 2T shows screen 220 which may be displayed if a user incorrectlyenters data while placing a new order. The text shown, “Error messageexample” in some embodiments may be replaced with text that specificallydescribes the error and how the user can correct the error.

FIG. 2U shows screen 221 which is shown when the user selects the“Add/View Photos” button on screen 208. In some embodiments, thesmartphone device camera is activated and allows the user to take one ormore photographs of the building if the user is at the buildinglocation. In other embodiments, the user is able to identify storedimages of the property, such as pictures previously taken, and add themto the order. In some embodiments, these pictures may be used during theprocess of analyzing the property during the processing and completionof the order. These photos may also be used as a part of the finalreport itself.

FIG. 2V shows screen 222 which is displayed when the “Measure Pitch”button is selected, such as the one in screen 208. In this embodiment,the screen is used to select two options to measure pitch via the “UsePhoto”, and “Use Accelerometer” buttons.

FIG. 2W shows screen 223 which is displayed when the “Use Photo” buttonis selected in screen 222. The smartphone camera is then activated andthe user takes a picture of the facet for which pitch is to be measured.FIG. 2X shows screen 224 which is the result of the picture-taking stepin screen 223. Here, the user has taken a picture of the gable of agarage in order to determine the pitch of each side of the gable. In theembodiment shown here, the user will use a “scissor marker” that isdescribed below in further detail.

FIG. 2Y shows screen 225 which is displayed when the “Use Accelerometer”button is selected in screen 222. In one embodiment shown here, thesmartphone acts as a carpenter's level which can be placed against asurface for which the pitch is to be measured, such as against a rafterto measure its pitch. Once the smartphone is in place, the user selectsthe “Measure Pitch” button. Other processes and methods of determiningpitch are described below.

FIG. 2Z shows screen 236 which is displayed as a result of the pitchmeasurement from screen 225. Here, the pitch is reported in standardroofing terminology of 5/12. In other embodiments, the pitch may berepresented as an angle, a gradient, or some other measure.

FIG. 2AA shows screen 227 which is displayed after a roof pitch isdetermined, for example from screen 225. Here, the user would accessscreen 227 by clicking the “Edit Report” button under a completed orderdetail page. In some embodiments, this would also be an additionalbutton to the “View Report” page. Here, the property manager system onthe smartphone that has received detailed data on the structure of theroof, for example through a completed roof report order, and canconstruct a two-dimensional or three-dimensional diagram of the house.This diagram would then be shown on screen 227 for the user to assignpitches to individual facets of the building. In one or moreembodiments, this model of the house can be scrolled, or zoomed in orzoomed out to view the full structure, and to read or apply properpitches.

FIG. 2AB describes screen 228 which allows the user to change settingswithin the property manager system on the smartphone by selecting thesettings button on the lower right portion of the screen. Here, the usercan adjust account information, such as whether to use the currentlocation of the smartphone device as a location for the account, orwhether to automatically fetch order information corresponding to theaccount location, or whether to wait for the smartphone user to ask fororder information to be downloaded. In addition, the user can choosewhether to show claim ID within reports, and also specify additionalemail addresses to which reports should be sent.

FIG. 2AC shows screen 229 which is displayed by selecting the rightarrow next to “Fetch Order Info” on screen 228. Here, the user is ableto select how data that is updated on the server may be sent to thesmartphone. This data may include but is not limited to order status,order information, a final property report, or any otherproperty-related data, which may include three-dimensional models,diagrams, or data. A user may turn the push feature on if the user has alow-cost/high-bandwidth data connection such as a Wi-Fi connection. Ifthe user has a slower or more expensive data connection, the user mayturn the push feature off, and instead specify at what intervals datafrom the server should be fetched. In one embodiment described in screen229, the user is given the option to fetch data every 15 minutes, every30 minutes, hourly, or to not have data automatically fetched at all butrather wait for the user to manually ask for the data.

In other embodiments, different methods may be used to determine whatdata is sent from the server to the user's smartphone, and at what timeit is sent. For example, suppose a roof report for a property existsthat contains roof measurements, a three-dimensional model of the housestructure, pitch data for facets of the roof, total living area,property condition assessments, and several pictures of the house andsurrounding area. If this roof report on the server that was downloadedto the users smartphone device has been subsequently changed, forexample additional images of the property have been added to the reportat the server, it is not necessary to resend the entire roof report, butonly send the data that has changed. In one embodiment, this isaccomplished by looking at the timestamps of the relative files, andonly sending data from the server that has a timestamp newer that thetimestamp on the corresponding data on the smartphone device.

FIG. 2AD shows screen 230 which allows the user to designate data fieldsto display. Here, the user has the choice of Cat ID, claim number, batchID, or status.

The assignee of the present application, Eagle View Technologies, hasfiled a number of applications on various software products that assistcontractors in preparing bids to repair roofs, install siding andperform construction products. The issued patents include U.S. Pat. Nos.8,170,840; 8,078,436 and the pending applications include Ser. Nos.13/757,694 and 13/757,712 both of them filed on Feb. 1, 2013 and namingChris Pershing as an inventor. The patents and applications provideexamples of reports that are supplied to contractors to assist them inpreparing construction bids. According to one embodiment of the presentinvention, a contractor or other user can receive these reports as anactive computer data file and sent to the property management system onthe user's smartphone.

FIG. 3A-3X shows another embodiment of a property manager system on asmartphone device.

FIG. 3A shows screen 231 which is a welcome screen displayed to the userthat allows the user to login by providing an email and a password, orto create an account on the smartphone.

FIG. 3B shows screen 232 which is displayed when the user selects“Create Account” on screen 231. The user is asked to enter an email,password, and then retype the password. To create the account the userselects the continue button.

FIG. 3C shows screen 233 which is displayed when the user selects thecontinue button on screen 232. The user is asked for a first name, lastname, phone with extension, and company name. To enter this informationthe user selects the continue button.

FIG. 3D shows screen 234 which is displayed when the user selects thecontinue button on screen 233. The user is asked to enter an address,city, state or province, and zip or postal code. To enter thisinformation the user selects the continue button.

FIG. 3E shows screen 235 which is displayed when the user selects thecontinue button on screen 234. The user is asked to enter billinginformation including first name, last name, billing email, and phonenumber. The user also has the option to select the checkbox whichindicates that contact information should be used for billinginformation. To enter this information the user selects the continuebutton.

FIG. 3F shows screen 236 which is displayed when the user selects thecontinue button on-screen 235. The user is asked to enter billinginformation including company name, company address, city, state orprovince, and zip or postal code. To enter this information the userselects the continue button.

FIG. 3G shows screen 237 which is displayed when the user selects thecontinue button in screen 236. The user is asked to provide emailinformation that is used to send notification and reports to. The usermay choose to use the login email address, or specify another emailaddress to be used. The user may also request to be sent email regardingnew products and services from EagleView Technologies, Inc. Finally, theuser is asked to check that the terms of use have been read and agreedto. To enter this information the user selects the create button.

FIG. 3H shows screen 238 which is displayed when the user selects thecreate button in screen 237. This screen informs the user that anaccount has been created, and allows the user to go to the main menu orto place a new order.

FIG. 3I shows screen 239 which is displayed when the user selects themain menu button in screen 238. This screen gives the user the option toplace an order, manage my properties, view order history, or changesettings.

FIG. 3J shows screen 240 which is displayed when the user selects theplace order button in screen 239, or selects the new order button inscreen 238. The screen allows the user to place an order for a propertyproduct. The screen allows the user to use an existing property in theproperty manager system, or to specify a new address to be used. Theuser may also give this new address a property name for easy referencein the future. In addition, the user may use a map view to identify theproperty location. The user also has the option to add and edit photosrelated to the property at the time the order is placed. For example,the user may be at the property location use the camera in thesmartphone to various pictures of the building and surrounding area tobe used when the order is processed, or to be attached to the order oncethe order is complete. The user selects the place order button once alldesired information is added.

FIG. 3K shows screen 241 which is displayed when the add button ofscreen 240 was selected for no data was entered into any fields. Acircle with a small “x” is displayed to indicate the error.

FIG. 3L shows screen 242 which shows the user entering an address intothe place order screen, and assigning the property name “Jessica's StormRepair” as a reference to this order.

FIG. 3M shows screen 243 which is displayed as a result of selecting theplace order button of screen 242. Here, the property management systemfound an already existing address corresponding to 123 Main Street inSeattle. The system displays an error message and suggests the userselect either the existing property feature of screen 240, or add anumber or a description in the building ID field to associate anotherbuilding with this property.

FIG. 3N shows screen 244 which reports a product has been successfullyordered. The user is given the option to place a new order, or go tomanage my properties.

FIG. 3O shows screen 245 that is used to confirm an order prior to theorder being placed. The screen consists of the order address, with abutton next to the address that allows the user to add additionalphotos, either from the smartphone camera or from an existing image. Inaddition, the user is asked to select a type of report, in this case aPremium Residential report. A delivery option may also be selected, inthis case a Three Hour Delivery. The user may also specify the number ofstructures at the address, in this case there is one structure, and tospecify whether there had been any changes in the last four years. Inaddition, the user is able to select report photos, in this case photosto be included along with the received report. The user selects theplace order button to continue to the payment option.

FIG. 3P shows screen 246 that is used to receive credit card informationwhen submitting a report. The user is asked to enter a card type, suchas Visa or American Express, the card number, and expiration date. Toplace the order, user selects the place order button at the lower right.

FIG. 3Q shows screen 247 that is displayed as a result of the userselecting manage my properties in screen 239. In this screen, lists ofproperties managed by the user are displayed. The properties areidentified by property name, address, date and time associated with theproperty, and a thumbnail view of the property to the left. The useralso has the option to add a text annotation or additional photos orimages to the property. A particular property may be searched byentering a portion of the name or address into the search box at the topof the screen.

FIG. 3R shows screen 248 that is displayed as a result of enteringproperty information while placing an order. Once all information isentered, the user has the option to delete, cancel, or save the orderfor later placement.

FIG. 3S shows screen 249 which displays a completed report that wasordered by the user using the previous steps. This screen shows theorder ID number, address of the property, claim number if available, andone or more information items from the report. In this example, an areaof 3709 is shown, the pitch of the roof of the house is shown as 10/12,and the ridge lengths of the roof are shown as 94 feet. The user alsohas the option to view the entire report on the smartphone device byclicking the view report button in the upper right corner.

FIG. 3T shows screen 250 which is displayed when property photos thatare part of the completed report are reviewed. A list of photothumbnails is presented in a column that describes the content of theassociated picture. In this example, the user has selected the first andsecond images to update with new images taken by the camera in theuser's smartphone. Here, the first image was successfully uploaded andthe second image failed to upload. In some embodiments, the user candetermine as part of the settings how often and how many times thesystem should attempt to upload the image. This screen also allows theuser to add additional photos by clicking the add button in the lowerleft.

FIG. 3U shows screen 251 which allows the user to reorder the sequenceof the pictures. This screen shows the user successfully reordering thephotos. The user can confirm these changes by clicking the done buttonin the upper right-hand corner.

FIG. 3V shows screen 252 which allows the users to reorder the sequenceof the pictures. Here, the user is able to select the highlightedpicture corresponding to number two, and drag that up so that picturenumber two becomes the first picture in the list, and the former picturenumber one becomes the second picture in the list. The user willcontinue this process until the photos are in the desired order, thenthe user will click the update button in the upper right corner.

FIG. 3W shows screen 253 which allows the user to view the order historyfor products placed. The orders may be sorted as completed, in progress,or saved orders to be added later. The user may also do a text searchfor property information in the search box at the top.

FIG. 3X shows screen 254 which shows the three properties with completedorders.

Three Dimensional Models

FIGS. 4A-4E are examples of property estimation and inspection methodsand systems that run on smartphone or tablet devices that allow users tobuild, update, and use three-dimensional models of one or more buildingson a property. In some cases these three-dimensional models appear aswireframes, and may be used in conjunction with photos, report resultsdata, customer or user annotations, and data from any other source thatmay be related to the associated property.

There are a number of advantages for working with three-dimensionalmodels of buildings associated with the property. A user, which may be acontractor, can easily interact with the customer at the buildinglocation to help the customer choose a feature for the structure, suchas a certain type of siding for the walls of the structure, or type ofshingles for the roof. The contractor can select and apply examples ofhow the materials would appear on the structure, and then allow thecustomer to rotate the structure to see how the material would appear atdifferent angles. The advantage for both the customer and the contractoris a quicker decision from the customer that matches the customer'stastes. In another example, an inspector or estimator will be able totake a tablet, walk around a property, and annotate features of abuilding to make notes that may affect repair or insurance estimates.For example, an inspector may note bricks extending halfway up a wall.In another example, on-site inspectors may be able to fill in additionalinformation to be included in the three-dimensional model that could notbe identified during the original analysis of the property using aerialimages. For example, a tree may block a deck or a window from view onthe side of a house that could not be seen without an on-site propertyinspection. In another example, an on-site inspector or estimator canmake annotations on the three-dimensional model, such as describingconditions of a particular area of a roof. A contractor may use this toshow area of damage to a customer, or to describe to the customer how aproposed chimney, a proposed skylight, or a proposed room addition mayappear in final form.

FIG. 4A shows screen 255 which displays a three-dimensional wireframerendering of a complex roof of a home. The three-dimensional model fromwhich this wireframe is rendered may have come from a roof report fromEagleView Technologies, Inc. that was ordered by a user using theproperty manager system on a smartphone device. The model informationmay have come from other sources or multiple sources, including updatesto three-dimensional model made by the tablet user when inspecting theproperty location. In this embodiment, the wireframe may be rotatedusing the pivot tool in the center of the diagram, zoomed in using themagnifying glass, or rotated in the third direction by using the uparrow with the side cross arrow through it. In addition, because this ispart of the property management system, a customer can place a new orderfor a product by clicking the new order button, can look at the myproperties information associated with the user, review orders, orchange settings as described above.

FIG. 4B shows screen 256 which differs from screen 255 in that a higherresolution for the wireframe image is used.

FIG. 4C shows screen 257 which displays a top-down view of thethree-dimensional model of the house shown in screen 256. Here, theimage can be rotated clockwise or counterclockwise.

FIG. 4D shows screen 258 that describes an embodiment of a propertymanagement system on a tablet that is showing an order for an EagleViewroof report that has been processed and delivered to the tablet. Thereport includes the address of the property listed in the upper left,with a current image of the property immediately below the address. Thisimage shows damage to the property that needs to be repaired. The rightside of the report contains details such as order number claim numberarea of roof and so on. The lower right includes photos and graphicalrepresentations of the property. Here, the user can add their own photosto associate with the property, select specific photos to be added tothe roof report that is created for the property, view the property as aPDF document, or view the annotatable three-dimensional model of thebuilding on the property.

FIG. 4E shows screen 259 which is an example of a three-dimensionalwireframe model exported to other software systems, in this case byTurboViewer.

FIGS. 5A-5L are examples of another embodiment of a property managementsystem on a smartphone that allows editing and annotation to photos.

FIG. 5A shows screen 260 which shows an initial property managementsystem screen allowing a user to either sign in, or create a newaccount.

FIG. 5B shows screen 261 which allows the logged-in user to eithercreate a new property entry to look at the user's existing properties,or to adjust settings.

FIG. 5C shows screen 262 which is displayed when a user selects the newproperty button of screen 261 to create a new property entry. The useris asked to provide a name and address for the property, or optionallyto use the current GPS location of the smartphone as the address. Theuser is also able to add photos which may be taken using this camera inthe smartphone, or added from existing images. Users are also able toorder reports, such as a roof report from EagleView Technologies, Inc.by selecting the order report button. To make the change, the userselects the save button at the lower left.

FIG. 5D shows screen 263 which is displayed when the user selects the“my properties” button from screen 261. A list of properties isdisplayed including the property name, address, date related to theproperty, and thumbnail of the property to the left of the propertyname. In addition, additional files, and annotations may be added to theproperty by selecting the buttons immediately below the propertyaddress.

FIG. 5E shows screen 264 which displays the “Edit Property” screen toscreen identifies the property name, property address, and options whichmay be used to edit or annotate the property. In this example, the userhas the option to view or edit photos, view or edit the report, or addadditional photos. The user clicks the save button in the lower leftside to save edits made with the property.

FIG. 5F shows screen 265 used to edit report photos when the user hasselected the view/edit report icon in screen 264. The screen shows alist of images associated with the property that the user may select toadd to the generated report. The user also has the option to addadditional photos which can be taken from the smartphone camera, ortaken from images already available.

FIG. 5G shows screen 266 which allows the user to reorder the selectedphotos to be associated with the report.

FIG. 5H shows screen 267 which is displayed when the user selects theview/edit photos button in screen 264. This presents the photo editorcomponent of the property management system. The photo editor gives auser the ability to modify, annotate, highlight, or add notes to a phototo enable the photo to more accurately describe a condition or situationrelated to the property. In one embodiment the photo editor usesutilities grouped under the “tools,” “effects,” “finger draw,” and“notes.”

FIG. 5I shows screen 268 which is displayed when the user selects thetools button on the lower part of the screen. Tools include a squareindicator which can be used to drag and drop a square on the image tohighlight a particular area of the image, an arrow which can be used topoint to a particular feature on an image to highlight the feature, an“X” that can be used to place an “X” on the image to identify orhighlight a feature, a water drop to show areas of water damage, or atext box to place text directly on the screen.

FIG. 5J shows screen 269 which is displayed when the effects button isselected. This allows the brightness in the contrast of the image to beadjusted to make the image easier to view if it was photographed inharsh light, such as in the early morning.

FIG. 5K shows screen 270 which is displayed when the user selects thefinger draw to this tool allows the user to highlight areas of interestby drawing a line around the area using the user's finger.

FIG. 5L shows screen 271 which is displayed when the user selects thenotes button. When selected, a keyboard is displayed that allows theuser to enter in extended amounts of text describing features or damageto the area being viewed. This text is not displayed on the image, butis rather associated with the image and available for later viewing.

FIG. 6 shows screen 272 which is displayed when the user selects theinspection tool, which in one embodiment shows a top-down image of thebuilding and allows a user to make annotations regarding the featuresand conditions of different areas of the structure. In one or moreembodiments, this data is collected from two-dimensional orthree-dimensional models that are captured in reports received by theproperty management system on the smartphone. In one example, the datafrom the reports received may be from an EagleView Technologies, Inc.roof report or walls report.

In some embodiments, annotations may include capturing or adding voicecommentary, either as a running commentary or as part of the datapackage that is tied or tagged to a marker or indicator that is placedon a model or associated with a model.

This inspection tool has many advantages. For example, for an insuranceclaim adjuster in the field, the adjuster can use this tool to updatethe model of the building to represent additions to the building thatdid not appear in the model. The adjuster can also use this model fordescribed damage done by hail, fire, or other disaster. Data needed torepair the defect, for example the type of material, the amount ofmaterial required, and the like may be represented on the diagram. Insome embodiments, the materials may be able to be ordered directly fromthe screen using pricing estimator models.

Insurance underwriters may also use this tool to either augment orverify the risk management analysis of the property when determininginsurability or premium amounts. For example, location of fire hydrantsmay be out of date or hard to see from aerial images. The existence andlocation of fire hydrants can be easily added using this tool.

In this embodiment, the user may identify different facets or areas ofthe structure, for example areas X, V, U and the like on the drawing toidentify the facet or to associate related facets with each other. Theuser may also place pushpin icons in different areas on the structure toidentify damage, or other features the user wishes to call out. Inaddition, the user can attach additional photos to this model, by usingthe camera within the tablet device or by associating an existing imagewith the model. In some embodiments, information can be retrieved bytouching different areas of the image. For example, the user can tap afacet on the model to get information on that facet such as squarefootage or pitch. Finally, the user is able to record conclusions basedon the on-site inspection work done at the represented building.

Pitch Determination

FIGS. 2Y-2AA, and FIGS. 7-13 describe systems and methods fordetermining the pitch of an object using a smartphone. For roofingcontractors and other related trades that use the slope of a roof, aconvenient, accurate assessment of the pitch angle of a section of roofis important. The ability to assess pitch using a mobile device like asmartphone or tablet computer while standing on the ground offers afaster, safer, and more convenient alternative to climbing onto the roofor scaling a ladder to directly assess a sloped section of a roof usingmechanical or electronic pitch gauges that require physical contact withthe measured surface.

One method to determine the pitch of an object uses the smartphonedevice in the capacity of a carpenter's level to directly measure pitch.FIG. 2Y shows one embodiment to determine the pitch of an object byplacing the smartphone device at the desired pitch angle, and pressingthe measure pitch button as shown. In this example, a level moduledetermines the angle of the smartphone device by using the accelerometerdata and orientation sensors within the smartphone to determine theangle of the smartphone in relation to level. In some embodiments, thesmartphone device may be held against an angled rafter to determine itsangle from level. FIG. 2Z shows one embodiment where the anglemeasurement is displayed on the smartphone device as a pitch value. FIG.2AA shows another embodiment where the output of a pitch value for afacet of a building may be directly imported as a pitch measurementassociated with a facet of the building that is represented in a twodimensional or three-dimensional model of the building.

Another embodiment of the method to determine the pitch of an object isbased on using the smartphone device as a video-based carpenter's levelas above. However, the actual smartphone device is not used as aphysical carpenter's level. Instead, a fixed projected horizontal lineis displayed on the smartphone camera display screen. The projectedhorizontal line stays fixed relative to the smartphone device, eventhough images on the camera display will move as the camera moves. Todetermine the pitch of one side of a gable of a house, the user standsaway from the house, points the smartphone camera at the house to seethe side of the gable to be measured within the camera's field of view.The user then rotates the smartphone until the projected horizontal lineappears to be parallel to the side of the gable to be measured. Thismethod uses the smartphone device's orientation sensors to determine theangle of the smartphone device and the resulting pitch of the gable. Theaccuracy of this method is improved as the user stands further away fromthe object to be measured.

Another method for determining the pitch of an object uses thesmartphone device to capture an image and other optional metadata suchas device orientation and information, and GPS location, and then drawmarkers on the image that overlay the surfaces where the pitch is to bedetermined. FIG. 7 shows a context diagram showing positions and anglesfor the disclosed method. A user with a smartphone 302 stands at adistance “d” 304 from a wall 314 to determine the angle of the rake 316of the roof of the structure. The ground-level is represented by 312.Line 306 represents the level line between the smartphone 303 to thevertical line 320 passing through point A 318 of the structure. Line 308represents the angle at which the smartphone 303 is being held inrelation to Horizontal Line 306

FIG. 10B shows an example of a photo of a house taken with a smartphonecamera, where the house has a gable feature 328. FIG. 12 shows anembodiment of a scissor marker that is a composite of two linear shapesformed by the line from point 330 to point 332, and the line from point330 to 334, that visually present two angled surfaces commonly found ongables and gabled dormers 328. When applying this method of determiningpitch, either a live image as seen on the smartphone camera display maybe used, or a captured image may be used.

FIG. 11 shows an example of a scissor marker within frame 328. 330represents the top of the scissor marker which is typically placed atthe vertex of the angle to be measured, for example the top peak of thegable structure. Moving point 330 will translate the entire markereither up or down on the image while leaving the angle of the scissormarker constant. To open or close the scissor marker, the user moveseither point 332 or point 334 in the direction of the arrows shown,which changes the opening angle of the scissor marker.

FIG. 12 shows three different examples 336, 338, and 340 that show howthe smartphone's orientation sensor can be used to maintain a propervertical orientation of the scissor marker in a live image. This way,the user does not need to worry about the orientation of the smartphonein their hand, whether it is in portrait 336, landscape 340 or a skewedorientation mode 338 in between. When dealing with a live image on thecamera, the camera can be moved until marker 330 is visually over theapex of the gable 328 to be measured. In that embodiment, the scissormarker may be fixed to a position on the screen such that the user canmanipulate the opening angle but cannot translate the marker's position.The user to manipulates the orientation of the smartphone, therebymanipulating the displayed image under the marker. Once the appropriatesection of the image is under the fixed position of the scissor marker,the opening angle of the marker can be modified to match the angles ofthe underlying roof image.

For a captured image, FIG. 8 shows an embodiment where the orientationmetadata captured with the image provides context by which the propervertical orientation can be achieved. The scissor marker may betranslated around the screen, by selecting 330 and moving it until it isvisually over the apex of the gable 318. In one embodiment, thismovement can be accomplished by the user touching marker 330 with afinger and dragging it to the proper location over the image. Likewise,the opening angle between the two linear shapes can be similarlyadjusted by moving 332 and 334, either symmetrically or independently,to cause their corresponding lines that connect with 330 to overlay theedge of the gable image to be measured.

A scissor marker may exist in a number of embodiments. In oneembodiment, a simple version is a half-scissor, for example consistingof a vertical reference and one adjustable arm. In another embodiment amore complex version may be a scissor that includes a third axespointing orthogonal to the plane of the scissor. In this example, such adevice could be used to orient and/or rotate the scissor cursor aboutthe z-axis to compensate for an angle between the viewer and the gabledface. In another embodiment, the scissor curser allows the user to slidethe apex of the cursor along that third axes, for example to tilt theplane of the scissor to access the pitch of a hipped face.

In the above embodiments describing pitch determination, additionalaccuracy can be achieved by making corrections of perceived pitch due tothe position of the smartphone's angle of observation. As the userapproaches the building of interest, the horizontal distance from theuser's mobile phone 303 to the gable as distance “d” 304 becomes smallerand the projection of the gable within the image will appear to “flattenout,” and reduce the perceived pitch angle of the gable. This effect isillustrated in FIGS. 9A and 9B. By determining the angle “alpha,” foundin FIG. 7 between 306 and 310, the perceived pitch of the aligned pitchdetermination marker can be corrected to yield the correct pitch value.To determine angle “alpha,” the smartphone's orientation sensors areused to capture the inclination of the smartphone device “phi”, theangle of the “normal” vector 308 coming out of the camera with respectto the ground 306, either at the time of image capture by the smartphoneor in real time when viewing a live image using the smartphone camera.Using the approximate knowledge of the angular field of view of thesmartphone camera, the angle “beta”, the angle between 308 and 310 iscalculated using the pixel displacement of the location of the apex ofthe pitch determination marker 330 (in FIG. 8 ) that overlays Point A318 (in FIG. 7 ) from the pixel located at the center of the image atPoint B. The sum of the angle “beta” and the angle “phi” yields thedesired value for the angle “alpha.”

FIG. 13 describes another embodiment of the method for determiningpitch, where the apex 318 of a gabled roof section is aligned with anactive region 346. This active region may be identified as a dashedcircle 346 that appears on the camera display of smartphone 303. In oneor more embodiments this active region 346 may be moved by selecting anddragging it on a still frame of an image. The active region 346 may alsobe in a fixed position within a live image such that the user must movethe smartphone camera to translate the desired roof apex in the liveimage under the active region. Once the active region is in position,computer vision algorithms which in one or more embodiments involve edgealgorithms or boundary detection algorithms are used to assess theopening angle of the gable 328 and report its respective pitch value. Inone or more embodiments, a pitch determination marker value isdisplayed, along with a highlight on the image to show the identifiededges used to determine the pitch.

The various embodiments described above can be combined to providefurther embodiments. All of the U.S. patents, U.S. patent applicationpublications, U.S. patent applications, foreign patents, foreign patentapplications and non-patent publications referred to in thisspecification and/or listed in the Application Data Sheet areincorporated herein by reference, in their entirety. Aspects of theembodiments can be modified, if necessary to employ concepts of thevarious patents, applications and publications to provide yet furtherembodiments.

These and other changes can be made to the embodiments in light of theabove-detailed description. In general, in the following claims, theterms used should not be construed to limit the claims to the specificembodiments disclosed in the specification and the claims, but should beconstrued to include all possible embodiments along with the full scopeof equivalents to which such claims are entitled. Accordingly, theclaims are not limited by the disclosure.

What is claimed is:
 1. One or more non-transitory computer readablemedium storing a set of computer executable instructions for running onone or more computer systems that when executed cause the one or morecomputer systems to: determine a pitch of a roof of a structure byanalyzing one or more images showing the roof, at least one of the oneor more images showing the roof being an image obtained with a userdevice from the ground, the analyzing further comprising: align an apexof a gable of a section of the roof with an identified region appearingon one or more of a live image and a still frame image on a display of acamera of the user device; determine, once the apex is aligned with theidentified region, an opening angle of the gable utilizing one or moreof edge detection algorithms and boundary detection algorithms on theone or more live image and still frame image having the apex alignedwith the identified region; and determine pitch of the section of theroof based on the determined opening angle of the gable of the section.2. The one or more non-transitory computer readable medium of claim 1,wherein the instructions, when executed, cause the one or more computersystems to use a current location of the user device to identify ageographic location of the structure.
 3. The one or more non-transitorycomputer readable medium of claim 2, wherein the instructions, whenexecuted, cause the one or more computer systems to present aninteractive map of the current location of the user device on the userdevice and to receive a selection of the structure from a user markingthe structure with an indicator.
 4. The one or more non-transitorycomputer readable medium of claim 1, wherein the instructions, whenexecuted, cause the one or more computer systems to use the one or moreimages of the structure to generate a three-dimensional model of thestructure.
 5. The one or more non-transitory computer readable medium ofclaim 4, wherein the instructions, when executed, cause the one or morecomputer systems to generate a report including at least one imageshowing the structure and a representation of the three-dimensionalmodel.
 6. The one or more non-transitory computer readable medium ofclaim 4, wherein the instructions, when executed, cause the one or morecomputer systems to allow a user to show representative buildingmaterials applied to the three-dimensional model.
 7. The one or morenon-transitory computer readable medium of claim 1, wherein theinstructions, when executed, cause the one or more computer systems toalign the apex of the gable of the section of the roof with theidentified region appearing on the live image on the display of a cameraof the user device; and wherein the user device is moved to align theapex of the gable with the identified region.
 8. The one or morenon-transitory computer readable medium of claim 1, wherein theinstructions, when executed, cause the one or more computer systems toalign the apex of the gable of the section of the roof with theidentified region appearing on the still frame image on the display of acamera of the user device; and wherein the identified region is moved onthe display to align the apex of the gable with the identified region.9. The one or more non-transitory computer readable medium of claim 8,wherein the identified region is a dashed circle.
 10. The one or morenon-transitory computer readable medium of claim 1, wherein theidentified region is a dashed circle.
 11. A method, comprising:determining a pitch of a roof of a structure by analyzing one or moreimages showing the roof, at least one of the one or more images showingthe roof being an image obtained with a user device from the ground, theanalyzing further comprising: aligning an apex of a gable of a sectionof the roof with an identified region appearing on one or more of a liveimage and a still frame image on a display of a camera of the userdevice; determining, once the apex is aligned with the identifiedregion, an opening angle of the gable utilizing one or more of edgedetection algorithms and boundary detection algorithms on the one ormore live image and still frame image having the apex aligned with theidentified region; and determining pitch of the section of the roofbased on the determined opening angle of the gable of the section. 12.The method of claim 11, comprising: using a current location of the userdevice to identify a geographic location of the structure.
 13. Themethod of claim 12, comprising: presenting an interactive map of thecurrent location of the user device on the user device and to receive aselection of the structure from a user marking the structure with anindicator.
 14. The method of claim 11, comprising: using the one or moreimages of the structure to generate a three-dimensional model of thestructure.
 15. The method of claim 14, comprising: generating a reportincluding at least one image showing the structure and a representationof the three-dimensional model.
 16. The method of claim 14, comprising:allowing a user to show representative building materials applied to thethree-dimensional model.
 17. The method of claim 11, comprising aligningthe apex of the gable of the section of the roof with the identifiedregion appearing on the live image on the display of a camera of theuser device, wherein the user device is moved to align the apex of thegable with the identified region.
 18. The method of claim 11, comprisingaligning the apex of the gable of the section of the roof with theidentified region appearing on the still frame image on the display of acamera of the user device; and wherein the identified region is moved onthe display to align the apex of the gable with the identified region.19. The method of claim 18, wherein the identified region is a dashedcircle.
 20. The method of claim 11, wherein the identified region is adashed circle.